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This study of 20 preservice teachers in a secondary 
English methods course explored whether materials on diversity, 
information about language of wider communication, and literature 
from parallel cultures would have a positive effect on their ability 
to fairly assess work by high school students from diverse 
populations. At the beginning of the semester, the students scored 
and discussed two sets of essays written by tenth- and eleventh-grade 
students. These essays had already been scored by experienced 
teachers; these scores and the authors' ethnic identities wore hidden 
from the ^''ducation students. During the rest of the semester students 
studied pedagogy, assessment, and issues of diversity including 
differences in prose development from culturally diverse writers. 

They also read secondary level literature by nonmainstream writers. 

At the end of the semester students evaluated the essays again. A 
comparison between student ratings in the first and second round 
found that: (1) all but one preservice teachers* scores were lower 

than those of the expert raters; (2) in all cases but one, preservice 
teachers' first scores either remained constant or were raised 
substantially by the end of the semester; and (3) essays which 
received large jumps in scores were written by students whose 
ethnicities were very apparent in their work. The paper includes 
scoring guide, table of the experts' and preservice teachers' scores, 
essay assignment, and a student essay, "The 'Addquin' Streets of the 
'Barrio'." (JB) 
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This paper is a pilot study predicated on three areas of 
concern for those of us mho uiork mith preseruice English 
teachers. The first is the demographic issue of our increasingly 
multicultural student population. To cite just one source, the 
nem Encyclopedia of English Studies and Language. Brts{ \ 994, 

Uol. I, p. 337), 

approKimately 40 percent of classrooms in the United 
States are already comprised of children from diuerse 
groups . . (This number Is) (projected to increase to one- 
third of the nation by (the year) 2010, and one-half by 
2050). 

Rnd— unlike many culturally and linguistically diuerse students of 
a generation or tmo ago mho sought (more successfully) to 
assimilate-many of "today's diuerse groups haue a strong 
desire to retain the language systems of their cultural heritage." 

The second demographic issue is that me are and mill 
remain a predominantly monocultural teaching force for many 
years, fls Florio-Ruane (1994) enplains, "despite our continued 
efforts to recruit and retain a racially, ethnically, and 
linguistically uaried teaching force," the typical beginning 
teacher in the 'yO's mill be female, . . . finglo ... and from a 
lomer- ... to middle-'income family (52). 

Zeichner (cited in Florio-Ruane, 1994, 52) notes the 
"relatiuely little attention In . . . teacher education reform to 



issues of educational and social inequality and to ideas about 
houj to prepare teachers more effectiuely to teach an 
increasingly diuerse student population. Haberman (1987) tells 
us that less than 5% of the appronimately 45,000 education 
faculty in the U.S. has taught for euen a gear in large urban 
school districts. 

Mg third concern comes from obseruing mg ouin students 
uiho lack the eupertise and confidence in assessing student 
uiriting-especially from diuerse groups, indeed, uiriting 
assessment is a major issue-not just in teacher preparation 
programs, but in the field of composition pedagogy in general. 

Though me all like to belieue that uie are looking for 
luriting-in keeping luith the best tenets of rhetorical theory- 
research tells us that me sometimes eualuate student mriting on 
the basis of other things-mhether me realize it or not. Nold and 
Freedman (1977) and seueral others haue shomn that teachers 
sometimes inaduertently euen remard such elements as essay 
length and handmriting. 

Ibhen me factor in cultural bias, me get into deeper 
trouble. For euample, mhen analyzing essays of African 
American students from an earlier study of the National 
Assessment of Educational Progress, Smitherman and LUright 
(Smitherman, 1985) found significant betmeen the 

frequency of mhat they call Black English and poorer scores. 

If me consider issues of second language use, problems 
mith rhetorical strategies mhich contradict those ualued in some 
western traditions, and other related cultural differences, our 



preseruice teachers (and those of us ujho luork ujith them) do, 
indeed, haue cause for alarm. 

Noui-taklng all three of mg points together-the changing 
demographics of our student bodies, the monocuitural nature of 
our teaching force, and preseruice teachers' lack of euperience 
assessing mritlng-especlallg from nonmainstream groups, I 
hgpothesized that materials on diuersitg, information about 
language of mider communication, and literature from parallel 
cultures mould haue a positiue effect on preseruice teachers' 
abilltg to more fairig assess mriters from diuerse populations. 

For this studg, I chose 20 students from mg English 
methods course. Rli mere from European Rmerican heritage 
eucept for one Chicana and one Japanese Rmerican. Most mere 
from rural areas in eastern lUashington, or from the larger 
Seattle-Tacoma area. Both groups described uerg little contact 
mith nonmainstream people, though some mere from regions 
mith large populations of Chicanos and Natiue Rmericans. 

I first asked students mhat characteristics theg should 
look for in eualuating essags. Their comments reflected their 
omn training, emphasizing components like clarltg and 
organization, logical arguments, attention to language 
conuentlons such as spelling, grammar, and sentence structure. 

I neut gaue them a rubric mhich has been adapted from seuerai 
commonig used holistic scoring guides, (see Figure 1) Rs me 
discussed these criteria, I reminded them that euen the finest 
essags mere not deuoid of errors. 



NeKt I gaue theoi the assignment that students mere to 
respond to. (see Figure 2) 

My students then scored tmo sets of essays mritten by 
tenth and eleuenth-grade students from Minneapolis, Minnesota 
and Daly City, California. Though they could use scores ranging 
from 6 to 1, I told them that they mere not required to use all 
the scores, that, indeed, they may find many of the essays quite 
comparable. Unbeknomnst to them, these essays had already 
been scored by four raters mith enperience teaching 
composition, morking mith ESL students, and morking in a 
unluersity mriting lab. I chose essays mhich had been ranked 
fairly euenly by prior raters. That is, ail essays had receiued 
auerage scores ranging from 4.5 to 5.66. (see Tables 1 and 2 for 
students' ethnic identity, gender, raters' scores, preseruice 
teachers' prescores and post scores) 

Also unbeknomnst to mg students mere the ethnic 
identities of the mriters— though in some cases the mriters 
identified themselues in their prose quite strongly. For enample, 
one student described her life in the Philippines before coming 
to the U.S. Another talked about life as an African American 
liuing in the Inner-city, and so on. Other essays mere more mhat 
one might call 'cultural, " that is, their ethnic identities mere not 
discernible from mhat they mrote. 

After students scored the tmo sets of essays, at the uery 
beginning of the semester, me discussed their assessments. Ibe 
talked about surface-leuel errors, especially as they pertained 
to language minority mriters. During the course of the 
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semester, I introduced uaridus other actiuities, strategies, and 
readings relatiue to composition pedagogy, assessment, and 
issues of diuersity. IPe looked at NCTE's position on "the 
students' right to their oum language," and differences in prose 
deuelopment from culturally diuerse uiriters. 

They read literature appropriate for secondary leuel 
students including such nonmainstream works as Laurence Vep's 
Dragon DUngs, Sandra Cisneros' House on Mango Street, Uirginia 
Hamilton's Ptanet of Junior Broutn, and Margaret Crauen's i 
Heard the Dud Caii Mg Same. Student remarked that prior to 
these nouels, they knew uery little of these nonmainstream 
writers, and euen less about some of the cultures they were 
reading about. This was for many of them a learning euperience 
in many ways. I ended the semester by gluing students the 
opportunity to eualuate the essays again. The second time 
around, their scores had changed, (see Tables 1 O' 2) 

Looking at this data, seueral factors become apparent: 

• In all cases but one, preseruice teachers' first 
scores were lower than the "enpert " raters. 

• In all cases but one, preseruice teachers' first 
scores remained either constant, or were raised 
substantially by the end of the semester. 

• 11th grade essay ^*i^9-written by a European 
flmerican-was rated higher during the first round of 
assessments, but came down somewhat during the 
second round. 



7 



• The European Rmerican score uihich u;as raised 
significantly (llth grade, #5) luas an essay which 
spoke with a uery strong personal uoice, an attribute 
my students didn't think they should ualue at the 
beginning of the course. 

• Essays which receiued large jumps, llth grade 
#2 and ^^6, and 10th grade #2 and #9, were written 
by students whose ethnicities were uery apparent in 
their work. 

• Finally, while African Rmerican scores came up 
slightly, these results were less dramatic. This data 
inuites further inuestigation. 

I will end this paper by presenting 10th grade essay #9. 

The score for this essay Jumped 1.21 points from the beginning 
of the semester. In many ways, this paper is the most 
interesting and created the most discussion among my students, 
(see Figure 3) 

fit first, this essay was the most discrepant. That is, some 
students thought it was encellent. But others said it didn't 
answer the question. After discussion, we came to the 
agreement that it not only fit the assignment, but was also a 
beautifully crafted piece. Since it did not fit the typical mold, at 
the first reading many didn't know what to do with it. Howeuer, 
on the second reading, hauing had many weeks to consider other 
perspectiues and other cultural points of uiew, most of my 
students felt it was truly one of the better essays in the group. 



Thus I ended this pilot study belieuing that if we are, 
indeed, to prouide proper eualuatipn for all of our students, we 
mus.' .oaden our uiew of equitable assessment, and ualidate 
the euceilent work of all of our students. 
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Figure 1 



Scoring Guide 



Essay must respond to assigned task, parts of 
which may be Implied. 



Score 

6 High degree of competence: Perhaps a few minor 

errors; Well organized, clear Ideas, syntactic 
variety, facility with language; Generally free of 
errors In usage, mechanics, sentence structure 

5 Clear competence: Minor errors; Generally well 

organized, explains key Ideas, syntactic variety, 
facility with language; Generally free of errors In 
usage, mechanics, sentence structure 

4 Competence: Adequately organized, explains key 

Ideas, adequate facility with language; Some errors 
In mechanics, usage, sentence structure 

3 Some competence but clearly flawed: One or more of 

these weaknesses: Inadequate organization, 

explanation of key Ideas; Pattern/ accumulation of 
errors In mechanics, usage, sentence structure; 
Limited or Inappropriate word choice 

2 Limited competence and seriously flawed: 

One or more of these weaknesses: Weak organization; 
Few related details; Serious errors In mechanics, 
usage, sentence structure, word choice 

1 Fundamental deficiencies: Serious errors. 

Incoherent, undeveloped 



Figure 2 



Assignment 

Many people feel that the communities they grew up in had 
a major influence on their lives. For some, the community 
provided a positive environment where they received the 
support necessary for growth, education, hope for the 
future. Others feel that their communities had a negative 
influence, holding them back through fear of violence or 
drugs, lack of support or opportunities to succeed. 

What kind of influence has your community had on you? 
Write an essay describing your community and show how 
some aspect of it has had a positive or negative influence 
on your life. 
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Scores from Raters and Preservice Teachers 



Table 1 



Grade 1 


1 


Raters' Score 


PreTI 


PreT2 


PreTI- 


Student 


American 


Gender Average 


Average 

(19) 


Average 

(19) 


PreT2 

Difference 



1 


European 


M 


5.25 


4.82 


4.96 


+ .14 


2 


Filipino 


M 


4.66 


3.56 


3.97 


+ .41 


3 


Latino 


M 


5 


4.74 


4.76 


+ .02 


4 


African 


M 


5 


4.48 


4.60 


+ .12 


5 


European 


M 


4.5 


3.78 


4.35 


+.57 


6 


Filipino 


F 


5 


3.84 


4.28 


+ .44 


7 


Latina 


F 


5 


3.75 


4.01 


+ .26 


8 


African 


F 


4.5 


3.86 


3.88 


+ .02 


9 


European 


C 

1 


4.5 


5.13 


4.95 


-.18 



Table 2 



Grade 


10 


Raters' Score 


PreTI 


PreT2 


PreTl- 


Student 


American 


Gender Average 


Average 

(20) 


Average 

(20) 


PreT2 

Difference 



1 


European 


F 


4.75 


3.95 


4.26 


+ .31 


2 


Latino 


M 


4.75 


4.25 


4.81 


LO 

+ 


3 








3.68 


3.88 


+ .20 


4 


Filipino 


F 


5.5 


4.78 


5.14 


+ .36 


5 


European 




4.5 


3.49 


3.53 


+ .04 


6 


African 


M 


5 


3.93 


4.24 


+ .31 


7 


Filipino 


F 


5.5 


4.09 


4.10 


^.01 


8 


European 


F 


5.5 


4.18 


4.35 


+ .17 


9 


Latino 


M 


5.66 


3.69 


4.90 


+ 1 21 


1 0 


Filipino 


f- 


4.75 


4.31 


4.38 


+ .07 




